An End-to-End Goal-Oriented Dialog System with a Generative Natural Language Response Generation
نویسندگان
چکیده
Recently advancements in deep learning allowed the development of endto-end trained goal-oriented dialog systems. Although these systems already achieve good performance, some simplifications limit their usage in real-life scenarios. In this work, we address two of these limitations: ignoring positional information and a fixed number of possible response candidates. We propose to use positional encodings in the input to model the word order of the user utterances. Furthermore, by using a feedforward neural network, we are able to generate the output word by word and are no longer restricted to a fixed number of possible response candidates. Using the positional encoding, we were able to achieve better accuracies in the Dialog bAbI Tasks and using the feedforward neural network for generating the response, we were able to save computation time and space consumption.
منابع مشابه
Adv . Topics in NLP : Language Grounding for Robotics Mohit Bansal
We present a novel response generation system that can be trained end to end on large quantities of unstructured Twitter conversations. A neural network architecture is used to address sparsity issues that arise when integrating contextual information into classic statistical models, allowing the system to take into account previous dialog utterances. Our dynamic-context generative models show ...
متن کاملLearning Generative End-to-end Dialog Systems with Knowledge
Dialog systems are intelligent agents that can converse with human in natural language and facilitate human. Traditional dialog systems follow a modular approach and often have trouble expanding to new or more complex domains, which hinder the development of more powerful future dialog systems. This dissertation targets at an ambitious goal: to create domainagnostic learning algorithms and dial...
متن کاملOnline Sequence-to-Sequence Active Learning for Open-Domain Dialogue Generation
We propose an online, end-to-end, neural generative conversational model for open-domain dialog. It is trained using a unique combination of offline two-phase supervised learning and online human-inthe-loop active learning. While most existing research proposes offline supervision or hand-crafted reward functions for online reinforcement, we devise a novel interactive learning mechanism based o...
متن کاملNatural language response generation in mixed-initiative dialogs using task goals and dialog acts
This paper presents our approach towards natural language response generation for mixed-initiative dialogs in the CUHK Restaurants domain. Our experimental corpus consists of about 4000 customer requests and waiter responses. Every request/response utterance is annotated with its task goal (TG) and dialog act (DA). The variable pair {TG, DA} is used to represent the dialog state. Our approach i...
متن کاملTowards End-to-End Learning for Dialog State Tracking and Management using Deep Reinforcement Learning
This paper presents an end-to-end framework for task-oriented dialog systems using a variant of Deep Recurrent QNetworks (DRQN). The model is able to interface with a relational database and jointly learn policies for both language understanding and dialog strategy. Moreover, we propose a hybrid algorithm that combines the strength of reinforcement learning and supervised learning to achieve fa...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2018